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Part C: Courseware Evaluation Summary ....«; 



INTRODUCTION *~ 

Purpose 

" This booklet consists of a Microcomputer Courseware Evaluation ^^^^^Mon 
products were developed in response to a. widely felt need ^^^^U^n!^- : 

and comprehensive courseware evaluation. ^ - ^ 

AudienGe "l ^ '-a . • 

intended audiences-for the package are— ', 

. vocational and technical educators in all subject matter areas Who are determining tftfc 
quality of courseware. , i_ 

• . professional reviewer* who conductand publish reviews of courseware, and 

- . . developers Who seek to produce high-quality cpurseware for vocational and techmcal 
education. 



Suggested Procedures for Use 



The courseware evaluation form can be removed from the center of this b °°^f • '^^f. 
guide intact foHuture reference: Users are encouraged to review the entire guide before using the 



form: > ..u | , 
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COURSEWARE EVALUATION GUIDE 



Evaluation Form Explanation ' 

Part A , v • "\ " \ * . ' : v . - 

Part A contains descriptive information about tfie courseware product and should be filled out 
as accurately and completely as possible. The needed information may be located in the,hard- • 
copy documentation or within. the program itself. Part A can serve as an initial screening device ta 
determine whether the courseware review should be continued; for example, if the courseware is 
not compatible with the hardware or instructional setting- it probably would not be worthwhile to 
continue the evaluation process. : ^ 

~ Part Br " ; . - ■ ■ ,' : V ' \^ 

• Related evaluation criteria are organized into eig-hl sections. Each section represents a cluster - 
of criteria needed for courseware evaluation and selecti.on. It is important toViote, however, that / 
another element must be added to these criteria in order to arrive at a suitable evaluation of the / 
^^gyjis^-ware: your own judgment. Although ^each criterion is an important indicator of quality, the J 
overall evaluation of the courseware depends bh yourt analysis of these criteria in relation \o your j 
own needs; therefore, it. is important to keep several points ih mind when completing this part of 
the evaluation form: .» ...... > / ■ ..... 

• The criteria in the courseware evaluation form are numerous but not exMUstive |hd - 
represent current knowledge and perceptions regarding courseware equation. As tech- 
nology advances, interpretations ot what constitutes high-quality cour^" 
change.- ' : ■■ 



An attempt has been made to present-the criteria objectively. However, some criteria 
reflect a certain degree of subjectivity and personal values (e.g., "Prggram promotes 
prod uctivity''). . • . ' *• 



— ^ No relative importance is assigned to individual criteria. The valqe attached Jo individual 
criteria is situation-dependent: each User must weigh criteria in light of the situation: 

t . • i ........ ' f '- • ' • . . 

- • The suggested evaluation procedure does hot explicitly provide for observation of ^student 
use'of the courseware. This could be included in an evaluation, however, at the judgment 
of the user. 

In completing Part B. the user should first decide which whole sections are applicable to the 
specific courseware being reviewed and then mark each section either : — _ A for applicable or * 

_..N/A for not applicable. Then a response Should be given for every criterionin each section 

marked A: • • ? ' ■ - ' 



■\YES.indicates that the criterion is fulfilled. 

SO\1EWH/JiT indicates that the criterion is only partially fulfilled. 

EEST.COPUmABlE 
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' : "U ^ ihdiSt%i.th8t-thp cfiteFion is riot fulfilled within the program but should be. • 
% ... ; • ' n/A indicates that the criterion is not fulfilled arid does not need to be; j 

•„• . The eeSE^TS-cblumn should be completed, at least for every item checked SOMEWHAT 
to exp^^HheT Why that rating was g^ W^AP^ , 
nnrior incji^rtinnal Setting in Part A of the courseware evaluation form, Section V.lll snouia De 
Completed along -with wy ^ ^tai^on^ 

importance of application programs in vocat.onal and technical education and because they 
require £ different set of criteria for evaluation. , •'. _ . i 
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be 

ceVtai 

initial screening itetice. 



Branching 



Courseware 
Disk , 

Documentation" 



Hardware 




Program Mode 

Series 



^Support Materials 



x 



Glossary 



Program h designed so that student progress is determined by the spe-i 
cific answers given. ■ . ' " v ; j: • 

Combination of disk (or other medium of transfer) and the accompanying; 
'documentation and materials for instruction. . !_.-.:.•« 

Ttfm^tisually flexible, plate, on which data or programs are stored: 

.. _ description and instructions for use of a program. Documentation 
may be in hard copy or within the program itself. 

Response of program to user input of .information. 

Either a single kern or collection of mechanical or electrorric items s 
required for use of a microcomputer program. Examples of hardware 
include monitors and printers. _ 

The section of the compute r where i nstructions and dataware stored. _ 



bist of choices within a program from which the u^erjr^kes selections. 
Microcomputer unit Of instruction that can stand alone. •- 



The method or strategy Used in the presentation of the subject matter. 



A groups separate programs related to one another in ^at,each , pro- 
gram beaTsMn additionio-itrown title,^ collective title applying to-the . 
group as a whole. ■ 

Items that support the activities of the persons using the program (e-.g.. 
student workbook). — 



V 
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Suggested^Coy weware.Ey4luatidn Procedure > 



• ' *' T h.e i^ibwIH^ '••**uVo»«^1*r^^ p * *° r evalua'fingo/ocational and technical education . ; 
courseware It is-intended f'br begmriing 'ceurWv^re^iuatSrs;- Experienced courseware evalua- 
tors and prdfesiiqnarrevieWers'car| fdllpw me procedures isor adapt it .in. accordance with their 
baci^roundland noed .^th? steps. te'jU^^r^^urBSr^^teUows:^ . • ; - ..3 

■ i. Review the evaluation guideand form:. : •. - * • ■ j ■< . ' V- - ~ 

• *' ~2~> .Review the documentation found'4n the- hard Copland in the program. This' will necessi- 
; ' tate a cursory runrthrough ofthe program. •• J,--- • . . - - 

. ' .3 Complete Part A of the courseware evaluation form. The user may not be able to com- '••.* 
; ' - - piete all information requested in Part A. Complete as many of the items as possible. 

4 " Determine the feasibility of continuing the courseware evaluation. If there is compatibility 
• : ; ' between -the items completed in Part A and user needs, the evaluation process should 
'$;}: proceed;-«it there isrricbifl$iatibfflty the..evajuation prbcess may be discontinued-. 



> 5- ; 



Run the program as a good student; making correct responses. .. j 



6. Rerun the program asja poor student/making incorrect responses. 

7 • Complete PartB of the courseware evaluation form depending on theprogram mode 
checked If an application program is included in the courseware, complete Section VIM 
arid any other applicable sections of 'Part B^IHhe program mode is other than applica- 
tion, complete all applicable sections 6f Part 8. excluding Section VIII. j 

V-ff/- Summarize your ratings in Part B by completing Part C of the courseware evaluation 
' / y form. " • — ''■ ' 

— 9.'. Decide if the courseware meets the needs of the students. 
3Figu.Fe.i- pr&nts.tHis 8uggeit^,ddu'rseware evaluation procedure schematically. 
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Begin Course- 
ware Review 


• 


\ 


Review Evalu- 
BtioiH3itWe- 




f . 


and Form 





Run Program 
As Good , 
Student ■ 



Rerun Program 
As Poor 
Student 




Complete 
Section VI M 
of Part B 



Review Docu- 
mentation 

4K»rd Copy inii 
i n Program) 



Complete Part A 
of the Evaluation 
Fo rm i 




NO 



Complete 
Sections i-Vli 
of Part B As 

Applicable— 



Complete 
PartC 



Use 

Courseware 



. * s- 




stop y 



Figure 



1. Suggested courseware; evaluation procedure ' 
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Features of the Evaluation Form 

The Microcomputer Courseware Evaluation Form on the follpwing pages— 

* is comprehensive, covering all areas of vocational arid technical education, 

• may be adapted to meet specific instructionaHneeds. " \ 
•> . can be used with all types of courseware, . * ' • • 



• • is flexible In that drily applicable sections need to be used. . :. ^ 

• provides spac.*fbr VyHtteri cbmjfierits«jn addition to chicked 'ratings* ■ • ) • 

,'•; * allows Part A, Description, and'part C, Summary, to be combined arid used as a cur- 
■ sory screening evaluation if desired: and ■ 

* '• .'has an accompanying guide to assist .in the use of the form. . 




COURSEWARE EVALUATION FORM 



NOTE: If you are using this form for 'the: first 
time, read the instructions in the accompany- . 
frig Microcomputer Courseware Evaluation 

Guide.' ;. . " " "Y ; ; 



Evaluator . 
Position _ 
Bat e* " 



" *■ r Part A: Courseware Description 

In the following sections, record descriptive information about the courseware that you-are 
evaluating: ' *. ; :•" .- • ' 

I IDENTIFICATION ' • 

Program Title . . : 

'Series Title " v „ — 



Date 



^-■'Vocational Area(s) 



Subject Area(§)j, 
Topic(s) 



Developing Agency. 



Street or P.O. Box 



State- 



Zip. 



Phone( j 



AUthbr(s). 



Programmers) 



If HARDWARE REQUIREMENTS 
Microcomputer" _ 



(brand/model) 



K Memory Required— : 

(number) ^ 
Medium of Transfer (include number of each): 



Tape cassette 

ROM cartridge' 



■ Programming 



uage 



; .Svj" Rexibie.di^H 

flexible disk > ■ 

DOS Specifications . 



: Other. 



(specify) 



Other Specifications 



- Peripherals Needed (check all that apply): 

r Color monitor / % ' 

One disk drive : . ' * ' 

Two diskjdriv^s 1 

. ' -Plotter \ * • v 

. i _•_ _ _ . 

; Game oaddlefs) 

Joystick(s) ; • * 



^i' Modem N 

Mouse 

Printer 

Giraphics tablet 

_ tight pen. 

voice/sound . 

instrument 



Clock 

Video disk 

I Touch screen 

TeHrkey number 

pa'd 

Other. 



(specify) 



'NOTE: Provide the above information for any additional Hardware on which this pro gram 
* can£e used — -j_ : — _ : — — ' : — . " .> 
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III. PROGRAM FLATUSES (check all that apply): 
• . Network version provided 

^Multiple copies required 
Program can be modified - 

IV. INSTRUCTIONAL SETTING j : 

Programvfriode (check all that apply): 

Application 

— . - . —-b'rrtl^a nd practrce * ' — - « — 



:~ Program protected 
. _ Data disk needed 

Field-test data available 



1^; 



-: Educational 
— gaming 



. . Tutorial. 
;: Other — 



— Simulation 

Student Target Population (check all that appl$'_ 

- ' Regular * ■ Handicapped 

, Disadvantaged : ' ~ ■.' - ■ — Limited English 



(specify) 



Grade Level (check gll that apply): 

K-6 T ~ ,_r " r ' 9-10 ■ e • " • 

■ 7-8 : - . - ; 11-12 ■ - rf 

Instructional Grouping (check alJ.ihat apply): i 

— : \itt^,\ ndivrd u a i' — — — — * — — - — — - 

■ it Small group (up to 4) , 
~& Large group (4 or more) - * : 

^Prerequisite Student Skills (specify), _ 

* - - -. - * 

Accompanying Materials (specify types): 

_ — c _ _ „ — * i 



13-14 

.1L Adult 



L Bilingual 
Gifted 



Higher 
<■ Education 



; cbmpetjtive interaction 

— cooperative interaction 



Documentation 



Student support materials . 
Teacher su^ppft materials. 
Correlated materials — 



• Estimated Time for Use - 

V: AVAILABILITY . V. : " 

. • Free ; II 

(copies) *• • 

Loan — _ + '. 

:- (time) 't. 

■ Duplication (requestor sVppUes disk) 

Copyright Restrictions (explain) . 



Sale ■ Si- 

\ Rent S_ 



(•time) 



Preview Polfey (explain) 
-Update Policy. (explain) 

Contact _ — — 

• Street or P.O. Box 
City -I 



State. 



Phone ( :j 



10 



ij 



) ■ — : — —r, : - 


I - 






' ' } ~ 
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. . ~ -ft ' f — < ' ^ 


YES 


SOME- 
WHAT 


NO 


tf/A 


COMMENTS 


1 0 


ill. STUDENT.iNTeRACflON A _ N/A / ■ 


. _ i ■ ■ • ■ -' 


i :. Students c#n use the program 4vith smln- 
?* imai assistance. ^ -. 


: * 


- * \ 








--— • » .. , - -• j - : — - J** — - 

ry , 2. Stud entire actively involved in the. ' < 

nrrtrt I'll rTlf x «. 








* 




. * 

it ; 


\ 3. Stents con^rdHhe pace of th^ program. 


r ' |' 










4. Students can avcce&s the program 
V "menu(s)" to'ctiahg&^tivities. 


1 








... . - • ; 


5: Students are permftted to change ar?syver% 












6. Methods of 'responding correspond to the 

levei-df the program; • > , v 












' 7. Students' err5«5 qf.entry are 'processed so 
'^.—^l t h at. t h e K> t> ro g ram Jio at fni es to run. . 










'• ■- • * 


8. Studeltts caff a^ce^s available "help" and 
r~ ~ : "hint" options at any time. ' 












. 9. Students can enter or exit the; prpgram as 
desired. . — i— 












1.0. StUdent^cohtrol the sequence of the 
program. ... „.-v. ■ , --■ 












JV. PROGRAM INTERACTION A _ N/A' 




1. Feedback is immediate/'^ y, 












2: Cues and prompts are provided to assist - 
* students in answering correctly. ' 










. ; »* 


3. Feedback reinforces the correct 
responses. r * ; 












a PopHhark is nohthreatehihd. 


J - 










r 5. Program helps students understand wrong 
answers. '. w 










, / 


6. program gives the correct answer a|ter a 
reasonaD<e numuci ui imbo. 












7 Positive reinforcement is varied. 
* a; Program has fhe ability' to, bxan'ch/jbbp 
depending upon stuoents. perTurjridii^e, 












9. Feedback is on the-level of the student. 












V STU DENT EVALUA liUiN M - — — 




1/ Evaluation provides a means for measur- 
/ ing attainment of objectives. 












i: Program reports which it^ms were missed 
v~ and- which were correct. 
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YES 



SOME- 
WHAT 



N/A 



COMMENTS 



V STUDENT EV AL\j^T \QN-^— Continued 



4" Glass performance results are available to 
the^teacher. 

"5T. Program provides for printed copies of 
evaluations. 

6. Test" item formats a re suited to tfie material 
being tested. 

7. Jest ijtems are clearly st ated. 

8. T est item b ank is provided. 
VI . D OCUMENTATION —A - — N/A 

1. Documentation is easy to understand: 
2: Documentation rs accur ate. 



3.; -Jndiyiduaf student performance results are 
available to the teacher. ; 



3. Stude nt objectives are stated. 

4. Underlying con cepts are outlined. 

5 . - Skills to be developed are specified. 

6: Procedures for integrating the program 

into the cu rr iculum are provided. 
7: Follow-up activities^ are suggested; « 
8. Documentation explains the intended use 
of sup port materials . 



9. Sufficient information is provided to oper- 
ate the pr ogram. 

V II. WORK BEHAVIORS A N/A 

1. Program helps students identify their 
vocational Skills. 

2. Program promotes pr ide jh work. 

3. Pro gram prom ot es prbdugtiv/ity. 

4. Program e ncourages good work habits. 
5: Problem solvi ng is encouraged: 
6. Program promotes good human relations 

7 Program provides an opportunity for work 
Qgtigfaction and self-fulfillment. 

8 Program encourages creativity: 



" ' 


YES 


{SOME- 
WHAT 


NO 


N/A 


COMMENTS 


V.ill. APPLICATION' PROGRAMS _ A _ N/A •< 
(to be completed/for application programs omyj 




I. Program is aoapiaDie iu ine mccus ui mc 
student. 










• 


2 Commands Are easily remembered. 






— h 






3. Information is easily manipulated. 












4. Correctfbns are easy to make: 






— 




> 


5. Program includes all necessary variables. 












6. Program performs reliably. ■ . 


• 








! 


7 Program efficiently achieves its intended - _ 
purpose. 












8" Trial data are supplied for learning to run 
the program. _ v _ 












9. Program provides for use of printo/when 
hard copy of information IsladyantagebUs. 








a 




10. Program moves from operation to opera-: 
tion efficiently. 












1 1 . Program is compatible with other applica- 
tion programs. 












12. Program has a supplementary tutorial pfb- ^ 
gram available: r 













■ % 

14 

ERIC 



Part C: Courseware Evaluation Summary 

1. SUMMARY COMMENTS 

* * * • 

Identify strengths of the courseware: 

t . • . i «, . . ' * ' . * 

Identify weaknesses of the courseware: 



\ 



~~Describi5 Uses of the courseware in an instructional setting: 



2. SUMMARY^JpE-SECTION 
7 Rate the quality of the courseware for each applicable section of this form by checking the 
appropriate column: if not applicable, check N/A. 



YIS 



SOME- 
WHAT 



NO 



N/A 



I. SUBJECT MATTER: Content ha s educational value. 



II TECHNICAL PRESENTATION: Program is free of malfunc- 



tions, 



III. STUDENT INTER ACTIONi-Students are actively involved with 
the program. " ' ; «. ■ 



IV. PROGRAM .INTERACTION: Feedback is effectively employed. 



V. STUDENT EVALUATION: Evaluation adequately measures 
student progress. °i : 



VI. DOCUMENTATION-: Documentation is sufficient to run the 
program. _ A ■ 



VII. WORK BEHAVIORS: Program assists students in developing 
positive work attitudes arid skills. 



VIII. APPLICATION PROGRAMS: Program performs the task for 
which it is intended. ; 



3. FINAL RECOMMENDATION 

Check your recommendation for the courseware and explain your reasons below. 



. Highly recommend 
; Recommend 



Recommend with reservations 
Do not recommend 



... . 15 
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order of: 

$ 50 to $100. the discount Is 5% 
$101 to $200. \hi discount 1^10% 
$20j to $300. the discount is 15% 
$301 to $400. the discount is 20% __ 
$401 and above, the discbunt is 25% 

International Orders 

All orders, in any amount, from outside the United 
States and its possessions are to be paid in U S "cur* 
rency. Additional postage and handling charges may 
be added for foreign shipments if necessary. 



Microcomputer Courseware Evaluation Guide: Form and Guide 
for Vocational 'and Technical Education 

- — Developed by: 

Shirley A. Chase 

Ruth Gordon 
Richard C. Makin "v 



For Further information Cb_htact: 
The Program information Office _ 
National Center for Research in Vocational Education 
The Ohio State University 
1960 Kenny Road 
Columbus. Ohio 43210 
800-848-4815 or 614-486-3655 in Ohio 
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.Part^ 

Ah explanation of each item 
pages. : 

L iDENTIFiCATfON 

Program Title 

Series Title 
Vocational Area(s) 



Courseware Evaluation Form Item Definitions x 



in Part A of tine evaluation form is provided on the following 

■ I ' 



Subject Area(s^ 
Topic(s) 

Developing AgSricy 

■\ 

Author(s) T " - 

Pr6grammer(s) 



.Narrii of the specific mlcrocomputeMnstrdcWonaj program 
(e.g.. Introduction to Patterns) and^date-ofxJeveibpmerit. 

Name. of the microcomputer- instructional prograrr i series of ' 
which the specific prog r;am JS.a part (e:g:, Know Your Pattern is 
a series of programs}. 

One or more vocational or technical areas for ^whtcti [the pro- 
gram could be used* agriculture, business ancj off ite; health, 
home economics.'mdgstrial arts, marketing and distributive 
education, arid trade arid industrial. • 

" ... ■■ - • " t 

A rriore specific content level under the vocational area, (eg.; 
textiles and clbthirig). 

Specific topic(s) covered in the subject area specified (e. 
pattern alterations): 

The organization, agency or individual producing the course- 
ware, address and phone: 

Wtiter(s) of the content of the program. 

Persori(s) writing the content in programming language. 



X 



jj; HARDWARE REQUIREMENTS 



Microcomputer 

K Memory Required 
Medium of Transfer 
Programming Language 
DOS Specifications 
Other Specifications 
Peripherals Needed 



Type of microcomputer needed to run the program (e.g.. Apple 
lie). \ ;'. < 

Amount of memory needed to run the program (e.g., 48K). 

Means used for storing the program (e.g., flexible disk): 

Language used to program the content (e.g., BASIC). 

Disk operating system required (e.g., 3.3). 

Any additional requirements in relation to hardware. . 

Any add-on hardware units required to run the program (e.g., 
two*joysticks). •,. 
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:PROQR AM .FEATURES 
Network Versidri Provided - 

^Multiple Copies Required 

Rrogram Can Be Modified 

Program Protected 
Data Disk Needed 

Field'Test Data Available-. 

INSTRUCTIONAL SETTING 
Program Mode 



Program runs on a centrally located microcomputer and is 
relayed to numerous student terminals. . ._ * 

Disk must remain In disk drive during operation of the pro- • 
gram: requiring multiple copies if the program- is used by stu-^ 
dents simultaneously. .>..'.*•« ; • . 

Teacher can exercise the "list". command {access the lines 
making up the program) to mjake additions, deletions, or 
alterations. , , ' _ >> ' , 

Program cannot be listed (e.g.. lines making up the program ' 
cannot be accessed). . v :• • : - '~ ■ . 

Data bh file disk are required for the'retrieval of information 
needed to run the program (e.g.. employees and salaries to . 
generate a payroll). . : v « 

The results of field testing are available to prospective users of 
the program. ■ . •'• . .. . 



9 



student Target Population 
Grade Letel(s) 
Instructional Grouping 



Prerequisite Stud^mt Skills 



Strategy or method used to present the.content. 

Application: Provides a service by performing a job (e.g.. 
spreadsheet). ^ , Jy 

Drill arid Practice: Provides repetition of information^ skill; 
previously acquired. , 

Educational Gaming: Presents facts in new interesting ways 
and provides fbr logical guessing. 

Simulation: Presents' real or imaginary,events. compressing. 
extended time to develop.problem-solving skills in^a safe 
environment, 

tutorial: Introduces new concept(s) and provides for mastery 
learning by giving immediate reinforcement. ; 

-Type(s) of student for which the program was developed. 

Educational level(s) for which the program is intended: ^ 

Instructional grouping(s) of students with which the program -fr, 
bah be Used. Jf designed for group use, will the program stimu^ . 
- late cooperative or competitive interaction?: ' 

>Cqmpetericie3 s&dents must have before using the program: 
■ ~18 



Documentation ■ Instructions for Using' the program. Specify whether thes<* are 

given i iri the program i briH l printed form; 

Student Support Materials Accompanying materials for student use (e:g: n handouts, 
• workbooks). 

Teacher Support Materials Accompanying materials for teacher use (e.g.. program guide. 
1 ■ tests): ~ 



Correlated Materials 
Estimated Time for Use 



The prdgrarn and other instructional materials (e.g., textbook) 
are complementary: ^ 

Approximate time required to use the entire program*. 



V AVAILABILITY 



Free, Loan, Duplica- 
tion. Sale, Rent 

Copyright Restrictions 
Bkck-Up Rblicy • 



Preview Policy 

Update Policy 
Contact 



Means by which the prograrh may be obtained. 



The program is copyrighted (i.e.. reproduction or distribution 
of the program is forbidden without approval). 

Vendor makes a second copy ot the program available free 'or 
at a reduced cost. 



. .-i ..■■"r*J 



Courseware may be previewed befbrwpurchase under certafin 
conditions: 

Vendor "provides revised versions of the program. 

Name, address, and phone of organization; agency, or ^divid- 
ual from which, the courseware may be obtained. 
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Part B 

An explanation of each criterion in Part B of the evaluation form is provided on the following 
pages. , • .- . '■ * . o . . 

I. SUBJECT-MATTER " : : ' ; ^ ; * ^ ■ ' :r ' " : ' > 

'iT Subject jfiatte^ 

skills that can be used by students in their occupational .fields. ; 

• 2 Learning outcomes are" dearly identified for students^ f^f . e p 

. beginning or placed throughout the program id reflect the progressiveorder of the desired 

; ■■ iearning. ,: •? . . ■' _ . ~\ ' • '' : .'" - . 

3 information is correct (e.g.. graphs, text, statistics). ' ,, r : v v 

• •• 4. Subject matter is organized to reflect -the usual sequence of events (e.g.', simple to complex. 
'< ' ' chronological order). . . ' ' ; ' ... 
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5. Racfal;*thri£, or sex groups are neitheKdverrepresented'nbr undeVreprSserited. There are 
no inaccurate or biased generalizations about the characteristics of these groups. 



6. Vocabulary, readibility level, difficulty of the material and interest level'are suited.to the 
students: : - 

7. The sybject matter reflects the actual-knowledge and skills currently used in the occupa- 
tional area: 

8. Subject matter is written and presented in a manner to engage and maintain^students' inter- 
est in learning the concepts^or skills: -• * ^ • . ; : ^ 

9. important ideas and concepts are relnfo^ 

These same ideas and J concepts are synthesized^ summary.' 

■ * ; . ;U\ ' ' .■.*" .... ... 

10. ^Microcomputer capabilities (e.g., immolate feedback; untiring'repetitiori) appear to provide 

brie of the best ways of presenting the subject-matter. 

11. TECHNICAL PRESENTATION * : 

1. Program runs consistently throughout without glitches (e.g., program ric^s not stall). 

2. The program displays text, makes calculations, draws graphics, and gives feedback fast 
enough to maintain students' interest. ^ . 



3. Information is displayed \n a format that is Well designed ^nd uncluttered: Text is not ob- 
scured by^Wlay of graphics. i i: , 

• ' - .:• f^K- : -- ----- - : : 

4. Words are spelled correctly; grammar^nd punctuation are accurate throughout the 

. program..^ 

5. Instructions are consistent and unambiguous: complete, Understandable directions^*- 

given for running. the program. 

6. When color is used, it does not detract from the intended purpose of the program (e:g.. color 
makes material more realistic and ^interesting). / 

7 Audio is clear in tone and understandable, the/audio does not distract students from the 
• ' educational impact of the program. The program has an option to delete the audio when 
desired: , . * • 

8. Graphics, either still or animated, do not detract from the subject matter presented. They 
illustrate and add meaning to the material. 

III. STUDENT INTERACTION - ' v 

1. students pan use the program without excessive as 

2. Program promotes active rather.than passive involvement of sfudents by encouraging think- 
ing and problem solving. v . ■' 

' - ■ ■ • » 
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Students have controf over the amount of time spent on each activity, thus individualizing 
the instruction to thei/specific needs; 



A |ist of choices from which students can Select js provided: Easy access to this list is avail- 
able so students can make other selections when desired: ;■' ,: ) 



i 



5. The program offers a ws&/ of going'back to- make changes when a wrong answer or response 
is given. . \ 

6. The complexity of the type oh^esponse is based on the capability level of the students (e.g., 
excessive/keyboacding is not required if it has not been taught). • ■ 

7: The program is "crash-proof." it does not stop or forfeit information when students either 
give wrong responses accidentally or try deliberately to make it fail! „ 

8 When/ a student requests "Kelp/' the program gives further instructions, reviews previous 
instructions, or provides assistances in progressing through the program. - ' 

9. The; program provides students with the opportunity to exit when necessary (e.g.. class 
"periocl ends before program is completed) and to reenter at point ended, rather than start at 
• beginning of the program again. \. '":■■> 

10. Siudents can change the order in which they go through the, program. This p.ermtts Jhem to 
^ : gb back to review or pick up information not covered: . ; 

IV. PROGRAM INTERACTION 

i: /Program interacts as soon as student response is made (e.g.. informs student of accuracy^ 
/ of answers, presentsfurther information, or explains previous information). 

2. I |f the wrong answer is given, the program provides further information or clues (e.g., 
^ ■( number of letters in the correct word is provided.) 



3.1 Correct responses are recognized in a positive manner (e.g., student is complimented on 
I correct answer). The program's response to incorrect answers is not so interesting that 
J incorrect responses are encouraged. - ~ ' ■ 



Students are not addressed in a derogatory manner (e.g.. "You dummy") when incorrect 
answer is given. u * . . 



5. Program does more than merely review the material; it provides the reasonjhat the answer 
is incorrect (e.g.. "Answer Bis wrong because . . .*'). . 

6. The student is not per^nitt^d to continue making jncorrect answers indefinitely. It is not 
possible to arrive al t the (correct answer by the process of elimination. 

7. The type pfpositive reinforcement changes as the program progresses, smce feedback 
such^is ; "You're terrific" becomes tiresome when overused. 

8. Program offers activities based upon the student's responses. Branching offers alternative 
activities, with different levels of difficulty or interest. Looping is a repeat of the activity for 
review. .• -• ' . 

' ' • . . ' •* - 21 . : • 



97 The type and content of the feedback are geared to student comprehension. 



V. STUDENT EVALUATION. 



. 2, 



3. 



Evaluation included in the program {whether test items or performance typem based on 
the stated student objective's and indicates progress toward attainment of the'ttojectives. _ ■ 

The results of each student's performance on the eva[u^ibn are provided by the program 
(ITg., test score./fems correct, items wrong). Thisjnformatioh is protected by a separate 
^password for uffe by the individual student and th6 teacher: 

Program identifies for individual students the items for which correct and incorrect 
res p o nses were made. This assists students and teachers in understanding what corrective 
measures need to be taken. This information is protected by a separate password for use 
by the individual student and the teacher. 



A composite view of class performance is given (e.g., average, range, percentiles! on the 
evai'dmon: This information is protected by a separate password for use by the teacher. 



Hard copy, of both individual student and composite class results is available to the teacher 
^ jacilitate record keeping. Hardcopy of individual test results is available. to the student: 



he type of test item used (e.g., true-false, multiple choice, performance) is varied to 
^reflect the best method of determining student attainment of objectives. 

Test items are easy to understand. Content and vocabulary are consistent w^h those in the 
subject matter presented.,- 

A data bank.of test items provides the teacher with the capability of generating tests by a 
random sampling-of items. . 



VI. DOCUMENTATION 



1; 

2. 
3. 



4. 



5. 
6. 

7. 



The language, vocabulary, and organization of the material in the documentation are easily 
comprehended. 

All information is correct (e.g.. graphs, text, statistics). 

Expected learning outcomes are listed. If particular skills are to be developed, they are 
specified. ; . , 

An explanation of the ideas and principles from whichThe program was developed is given. 
The particular skijls to be learned through using the program are stated. 



The teachers given specific suggestions on where^nd ftow to combine the program with 
the existing curriculum. \ 

Suggested follow-up activities geared to the students are given to reinforce the information 
presented! 
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8. Recommendati6ns=arrwh#re arid how to use aif student materials are given, 

J. ; All necessary Information is provided so that teachers o^%tudent% caa ra^tfie program 
.: from start to finish regardless of prior e*peneriqe. * • ^ ■'■ ^ 



Vli. ^ORK BEHAVIORS 



• ' • 1 • Students are made aware of their competencies in relation to thei>Lorended occupations, 
individual strengths and weaknesses can be determined and used 1 as guidelines forf.urther 



development^ • . / 

2 - Program presents all work as tasks to toe-approached and carried dutm.a conscientious 
manner. Regardless- of the nature of the work, students are always encouraged to "give it 
their best effort." • ■' \ \' , - : 

3. Program encourages the ac/iievement Of maximum outcomes through the use Of available 
resources., ' - .(>. ' : v- 

4. Positive behaviors are advocated for getting, pVformmg, and keeping li job. Thepe behav- 
iors include dependability, punctuality.fcooperation.'and initiative. V - f-T 

5. ' Program encourages students to^olve problems and make decisions that have transfer- . 

ability to their occupations and everyday lives. - 

*6. ' Emphasis fs placed on "people skills"— the ability to communicate and get along with 

people. ' x . ' ' ; • " • 

I . • '_ y-_ « •:• - . 

7 Students complete the program feeling that they have accomplished something. Equally . 
important, the means of accomplishment leaves students feeling good about themselves 
and their ability to complete the task. ■■ ./ _ . 

8: Individual creativity is promoted through the opportunity to develop new ideas, products, 



or ways of performing tasks. 



; .; .. • < * ■ 

VIII. APPLICATION PROGRAMS 



1- 



Program offers sufficient versatility andidetail that the coverage and complexity of the pro- 
gram can be changed,to meet the specific needs of the students using it. 

Specific commands or.instructions to enter and manipulate data are logics/in nature arid . 
simple to use. \ . .- 

Process required to change data (frequently numbers) is simple. to. understand and easy to 



use. 



4. .Information being used in the program can be/corrected or changed at -any time without 
haying to rerun the entire program. ..' ' :. y . . . / . 

5. All fields and variables necessary to perform trie |ask are available, or the program is adapt- - 
able.so the necessary variables and fi.elds can be addejd. , 

' . * ■ " ' ■ v : •.• • ; ... : • . ■/' v , . ' 
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8. Program provides rhe same answer or oucome Mchri.me so that 6fie ian.de|ehd oh its.. , . 

'• accuracy. ' ■ . '-■ -X — : — [ ■ 

i 7: Program pertprms t^.tasit it is supposed to ab.- . .. . 

■ $ ^p^i^mi^m^ ?onree is^ldea "taming to FoS tfie jxpgraiti, 

9. Program provides for printer use when hard copy of the.resulting jnformat.on .s 
advantageous.' v - . ^ < j ' . ' ^ ".. ~ 

Kid" fhe.sequence in moving fromrone operation to another is%asy to understand^ and ^ \ ^ , 
implement: ; . .• '- ,'°r ■ '■' 1 1 ,° • • ' 

" 11. Program fs either bundled (designed to be •compatible ^^J^^^^^. 5 !'^ 
■ integrated (developed specifically to be combined -with other par^ular apphc^on. .; • 

•• -..programs). \' _ •'• ■■ \ / '.' :: ; 'y ; V' > 2 . i\ • . ' •; 

' '. • ife tutorial program presents the concerts and. information needed' in iearqing to operate the . 
application program: # - • ; . • v - ; 

■» . '\ ..**.■':'. ■* • . '*'._. ■ . •' ; ; • 

; *An ekplah.ation of each^item in Part C of the equation form is prided Wfollovk * V _V 

( , ^ .^K.ADv rnMMfiivJT^ Describe* thV advantages of jhi£ particular- ; '- . 

-1.: SUMMARY COMMENTS, _ . , courseware- Af possible, compare-it with other . 

/ ■ r v " courseware reviewed. ._ ' 5 

V "'; • Describe the disadvantages of this particular 

- • t • O/V ' •• coursew.are:Jf possible, compare it with other 

^ v- v courseware reviewed. < 

:; s v ■ . -J- : v. . ; * • ♦ "■ •• .... » * 

: . # -. - . explain different wSys the courseware might 

' > \ ' •; '* be 6sed in learning situations,, both in the v 

" '• , ,< x \ • classrodm^ind in informal settings. ) 

3 FINAL RECOMMENDATSON W : 1 ^ V^^^^SfcSSf^ 

^ / - . -: / v • v • wtiy that rating was given. 

' ■ ■ '■■ . : • : • , ., ■ '■' '. \ " : -t 

" - - • • • r : • r • _ ; • - ; • . ; • . ' ■ 

- i ■ ' I . - ~* ' ' . ■ .- ' !»- 

'* '. '• • "i " ' . ' - 

. : . -" ' • V ' .,- .-:>.• i • - • • - % 
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